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RESULTS  ON  CANCELLER  CONVERGENCE 
IN  NONSTATIONARY  NOISE 


1.  INTRODUCTION 

The  optimal  weights  associated  with  an  adaptive  canceller  arc  often  not  known  a  priori  and  thus 
must  be  estimated  by  using  finite  averaging.  Because  of  the  use  of  estimated  weights,  suboptimal 
canceller  performance  results.  Reed,  Mallet,  and  Brennan  [1,2]  quantified  this  performance  for  the 
Sampled  Matrix  Inversion  (SMI)  algorithm  in  the  transient  state  under  the  conditions  that  the  input 
noise  must  be  Gaussian,  stationary,  and  independent  from  time  sample  to  time  sample.  They 
mathematically  demonstrated  that  the  SMI  canceller  has  relatively  fast  convergence  characteristics  and 
also  that  the  convergence  is  independent  of  the  input  covariance  matrix. 

In  Ref.  3,  the  Reed,  Mallet,  and  Brennan  results  were  extended  to  include  the  effects  of  non- 
Gaussian  inputs  by  using  the  Gram-Schmidt  (GS)  canceller  [4-9]  as  an  analysis  tool.  It  was  shown 
that  the  GS  canceller  and  the  SMI  canceller  are  numerically  identical,  and  hence  the  SMI  can  be 
analyzed  by  using  the  GS  canceller  structure.  In  Ref.  10,  lower  and  upper  bounds  of  convergence 
performance  were  derived  for  when  the  input  noise  is  Gaussian  but  correlated  from  sample  to  sample 
(colored  input  noise).  In  this  report  the  methodology  developed  in  Refs.  3,  4,  and  10  is  extended  to 
analyze  a  canceller  in  temporally  nonstationary  noise.  Upper  and  lower  bounds  of  convergence  per¬ 
formance  are  again  derived. 

The  analysis  presented  in  this  report  pertains  to  the  adaptive  processor  in  canceller  configuration 
whereby  the  derived  signal  is  assumed  only  to  be  present  in  the  main  channel  and  auxiliary  channels 
are  used  to  cancel  correlated  noises  in  the  main  channel.  However,  Ref.  1  showed  that  any  noncon- 
strained  linear  adaptive  array  processor  can  be  transformed  into  a  canceller  configuration  without 
changing  the  output  noise  power  convergence  statistics.  Hence,  the  results  of  this  report  apply  to  any 
nonconstrained  linear  adaptive  array  processor. 

2.  THE  GS  CANCELLER 

Consider  the  general  /V-input  GS  canceller  structure  (Fig.  1(a)).  Let  xM(t),  *|(/) . .r/v_i(0 

represent  the  complex  data  in  the  0th,  1st,  . . .  ,  N  —  1th  channels,  respectively.  We  call  the  left¬ 
most  input  xM{t)  the  main  channel  and  the  remaining  N  —  1  inputs  the  auxiliary  channels.  The  main 
channel's  signal  consists  of  a  desired  signal  plus  additive  noise.  The  noise  consists  of  internal  noise 
plus  exicniul  noise.  Cancellation  of  the  signals  from  external  interfering  sources  relies  on  the  correla¬ 
tion  of  simultaneously  received  signals  in  the  main  and  auxiliary  channels.  The  internal  noises  on 
each  channel  are  assumed  uncorrelated  between  channels.  The  canceller  operates  so  as  to  decorrelate 
the  auxiliary  inputs  one  at  a  time  from  the  other  inputs  by  use  of  the  basic  2-input  GS  processor 
shown  in  Fig.  1(b).  For  example.  Fig.  1(a)  shows  that  .ty-ift)  is  uncorrelated  with 
xfyit),  x\2)(t),  .  .  .,  in  the  first  level  of  decomposition.  Next,  the  ,,utpui  channel  mat  results 

from  decorrelating  _  |  (r)  from  JtiV_2(/)  is  decorrelated  from  the  other  outputs  of  the  first-level  GSs. 
The  decomposition  proceeds  until  a  final  output  channel  is  generated.  If  the  decorrelation  weights  in 
each  of  the  2-input  GSs  are  computed  from  an  infinite  number  of  input  samples,  this  output  channel  is 
totally  decorrelated  with  the  input:  X\(t),  j t2(r),  . . .  ,  x,/v_1(r). 
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If  we  do  not  have  an  infinite  number  of  input  samples  then  the  decorrelation  weight  associated 
with  each  2-input  GS  canceller  is  estimated  by  using  finite  averaging.  The  three  methods  of  perform¬ 
ing  GS  cancellation  are  nonconcurrent,  concurrent,  and  systolic  processing.  The  last  two  are 
described  in  more  detail  in  Refs.  3  and  4.  For  this  analysis,  we  assume  nonconcurrent  processing 
whereby  the  GS  weights  are  estimated  from  a  block  of  input  data  and  applied  to  subsequent  or  previ¬ 
ous  input  data.  For  clarity,  data  that  are  used  to  calculate  the  GS  weights  are  denoted  by  lower  case 
v's  and  are  called  the  concurrent  data.  The  data  to  which  the  computed  weights  are  applied  are 
denoted  by  upper  case  X's  and  are  called  the  nonconcurrent  data. 

We  briefly  describe  the  nonconcurrent  GS  canceller.  Let  .vj"')  represent  the  outputs  of  the  2- 
input  GSs  on  the  (mi  -  1)  level.  The  GS  weights  are  computed  from  these  outputs.  Then  outputs  of 
the  2-input  GSs  at  the  wth  level  are  given  by 


m  =  0,  1 . N  -  m  -  1 . 

x{;r"(k)  =  .v r<A)  -  »r’vr,,,u-)  m  =  1, 2 . n  - 1  <n 

A  =  1,2 . K  . 

Note  that  v ’  =  ,v„.  The  weight  »  seen  in  Eq.  (1),  is  computed  so  as  to  decorrelate  ,v|'"  *  11  with 

xT-m-  F°r  K  input  samples  per  channel,  this  weight  is  estimated  as 


u 


,(m> 

tl 


*<A -jo*) 


k  _ 

E  kr,„(*)|- 

k  I 


(2) 


where  *  denotes  the  complex  conjugate  and  |  •  |  is  the  magnitude.  Here  k  indexes  the  sampled  data. 

For  the  nonconcurrent  canceller,  let  Xj”'1  represent  the  nonconcurrent  data  outputs  of  the  2-input 
GSs  on  the  (m  -  1 )  level.  Then  the  outputs  of  the  2-input  GSs  of  the  wth  level  are  given  by 


yint  *■  1 )  _  y(m) 
A  n  A  n 


’XV" 


n  =  0.  1 . N  —  m  —  1 , 

m  =  1,2 . N  -  1 


(3) 


where  X),h  =  X„  and  uj'"1  is  calculated  by  using  Eq.  (2),  i.e.,  these  weights  are  computed  from  a 
block  of  data  that  does  not  include  X„. 

For  this  development  unless  otherwise  noted  we  make  the  following  assumptions: 

1.  The  samples  ol  .v().  ,v  ( ,  ...  ,  _vjV  - 1  and  X0,  Xt,  ...  ,  X,V-|  are  Gaussian  complex  ran¬ 
dom  variables  (r.v.)  when  conditioned  on  their  respective  noise  power  level. 

2.  These  same  r.v.’s  when  conditioned  on  their  respective  noise  power  level  are  samples  from 
stationary  processes  with  zero  mean. 

3.  xn  (£,)  is  independent  of  X„,(Ai)  for  all  A,,  A2.  // 1 ,  n2- 


4.  The  desired  signal  is  not  present  during  weight  computation  and  is  not  in  the  auxiliary 
channels. 
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3.  OUTPUT  MEASURE 

Figure  2  shows  a  simplified  (V-input  GS  canceller  structure  for  nonconcurrent  processing.  GSK  N 
indicates  that  an  A-input  GS  structure  uses  K  samples  for  each  channel  to  compute  the  weights  interior 
to  the  GS  structure.  Note  for  the  nonconcurrent  structure  that  the  weights  are  computed  from  the 

v,|.  .V| . -*x-\  data  blocks  and  are  applied  to  X0,  X],  ...  ,  X^.].  The  Oth  channel  (or  the  far 

left  channel  in  Fig.  2)  is  always  designated  the  main  channel;  the  others  are  called  auxiliary  channels 
or  just  plain  AUXs.  me  output  of  the  nonconcurrent  processor  is  denoted  by  Zmi .  Figure  3  shows 
the  GS  structure  for  K  =  oo  where  the  concurrent  and  nonconcurrent  orthogonal  outputs  are  zn  and 
Z„.  //  =0,  1,2 . N-  1,  respectively. 


X0  X1  X2  X  N-1 


Fig  2  —  Representation  of  nonconcurrent  Fig.  3  —  GS  representation  with  N 

weighting  of  GS  canceller  orthogonalized  output  channel^ 

For  any  set  of  interior  GS  weights  estimated,  there  is  an  equivalent  linear  weighting  of  the  input 
channel.  We  denote  this  equivalent  estimated  weighting  by  the  /V-length  vector  w,  where 

W  =  (U'0.W, . W'yv  _  I ) r  (4) 

and  T  denotes  the  transpose  vector  (or  matrix)  operation.  For  the  GS  canceller  the  weighting  on  the 
main  channel  is  constrained  to  be  1  or  R'0  =  1.  Let  cr^in  be  defined  as  the  steady  state  output  noise 
power  residue  and 

R  is  steady  state  input  covariance  matrix  (main  and  AUXs,  an  N  x  N  matrix),  (5) 

R  is  estimated  input  noise  covariance  matrix  using  X0,  X! . %n-i 

(in  this  case  X0  consists  of  noise  only), 
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o~H  is  transient  output  noise  power  residue  associated  with  nonconcurrent  weighting 
normalized  to  errand 


a~nw  is  expected  value  of  averaged  over  X0 ,  X,,  ...  ,  X/v-i  . 
X-average  transient  output  noise  power  residue. 


We  call  this  quantity  the 


Note  that  the  last  three  quantities  defined  are  random  variables. 
By  using  the  above  definitions,  we  can  show  that 

A  /  A 

w  Rw 

2 

°min 


where  t  denotes  the  complex  transpose.  Note  that  because  of  assumption  3,  Section  2, 

A  f  A 

'  2  w  R  w 

G  nw  5  ' 

°min 


(6a) 


(6b) 


Also  since  vv0  =  1 ,  from  assumption  4,  Section  2,  the  desired  signal  is  passed  directly  to  the  output 
uncancelled.  Hence,  the  output  signal  power  is  unchanged  from  input  to  output  so  the  expected  value 
of  o,w  is  equal  to  the  cancellation  ratio.  We  define  the  normalized  output  noise  power  residue  as 

o;m(K,N)  =  E\a2nw )  =  E\a^),  (7) 

where  £|-|  denotes  the  expected  value.  Thus  the  above  is  the  average  (or  1st  moment)  of  the  tran¬ 
sient  normalized  output  noise  power  residue.  This  output  measure  is  commonly  used  to  grade  the 
convergence  performance  of  the  SMI  canceller. 

4.  INVARIANT  TRANSFORMS 

In  the  section,  we  discuss  two  types  of  matrix  transforms  on  the  input  data  that  significantly  sim¬ 
plify  the  analysis.  Let  C  be  any  N  x  N  nonsingular  matrix.  Reference  1  shows  that  transforming 
the  input  channels  jr0,  .v,,  . .  .  ,  xN_t  by  this  matrix  does  not  change  the  transient  or  steady  state  out¬ 
put  residue  of  the  GS/SMI  canceller.  The  GS  canceller  in  the  steady  state  is  equivalent  to  a  matrix 
transformation  of  the  input  data  vector  in  which  the  matrix  is  nonsingular  and  upper  triangular. 
Therefore,  we  can  transform  the  input  data  by  using  a  steady-state  GS  canceller  (with  its  orthgonal- 
ized  channels)  prior  to  performing  the  transient  analysis.  Figure  4  shows  an  equivalent  configuration 
of  the  GS  canceller  in  the  transient  state.  Here  the  matrix  transform  C  is  implemented  by  passing  the 
input  channels  through  a  GS^, iN  structure  followed  by  a  power  equalizer  on  the  output  auxiliary 
channels.  The  output  powers  of  the  AUX  channels  after  power  equalization  are  equal  to  a^in.  Note 
that  each  input  channel  into  the  GS*  N  structure  is  orthogonal  in  the  steady  state  to  the  other  channels. 
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The  structure  shewn  in  Fig.  4  illustrates  that  any  GS  canceller  structure  can  be  divided  into  two 
parts:  a  deterministic,  steady-state  frontend  processor  in  which  the  main  channel  is  decorrelated  from 
the  auxiliary  channels  and  a  stochastic  backend  processor  which  is  driven  by  uncorrelated  equal 
powered  noise  in  each  channel.  The  backend  processor  is  independent  of  the  input  covariance  matrix, 
and  the  auxiliary  weights  associated  with  the  backend  processor  go  to  zero  as  K  —  oo.  Hence  the 
convergence  properties  of  the  GS  canceller  can  be  studied  by  analyzing  the  convergence  properties  of 
the  backend  processor  whereby  the  input  channels  are  spatially  orthogonal  and  of  equal  power. 

A  second  matrix  transform  to  be  used  in  the  the  forthcoming  analysis  is  now  discussed.  Let  <f> 
be  any  K  x  K  unitary  matrix,  i.e.,  4>4>'  =  IK  where  lK  is  the  K  x  K  identity  matrix.  We  transform 
each  input  channel  ^-length  data  vector,  x„,  n  =0,  1,  2,  . . .  ,  N  -  1  by  4>  such  that 

<  =  *  =  0,  1 . N  -  1,  (8) 

where  x,[.  n  =  0,  1 ,  .  .  .  ,  N  —  1  is  the  resultant  output  data  set.  If  we  input  this  data  set  to  a 
GS^  v  canceller,  then  the  estimated  weights  using  the  \„  inputs  are  identical  to  those  using  the  x' 
inputs  [3). 


x0  x,  xN_, 
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5.  GS  DECOMPOSITION 


In  this  section  we  discuss  a  decomposition  of  a  GS  structure  that  was  first  introduced  in  Ref.  3. 
A  GSa-  ,v  structure  can  be  decomposed  as  shown  in  Fig.  5  into  a  first-level  processor  followed  by  a 
GSyy_  |  structure.  The  output  /^-length  vectors  (those  used  in  computing  the  next  level  weights)  of 
the  first-level  processor  can  be  written  as 


y„  =  x„ 


U'„  X 


« -\V  -  1 


vv„ 


X/V-|Xn 

xjtf  _  1  Xyv  _  , 


,  n  =  0,  1 . N 


(9) 


or 


Thus 


X'v-|Xl( 

y„  =  x„  — - - x,v  _ , . 

X  \  -  1  X.v  -  I 


y„  = 


Ik  ~ 


X,V  -  I  X,y  _  | 
xfv  - 1  x.v  - 1 


X„. 


n  =  0.  1,  2,  . 


N  -  1. 


It  can  be  shown  [3]  that 


Ik 


X.V  -  I  Xy  _  i 

Xy  _ 1 Xy  _ I 


4>'r<i>, 


(10) 


(in 


X0  X1  X2  XN-2  XN-1 


N  -  1 


Fig.  5  —  Decomposition  of  GS*  v 
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where  <l>  is  a  K  x  K  unitary  matrix  and  T  is  a  diagonal  matrix  whose  first  element  is  0  and  all  other 
diagonal  elements  are  equal  to  1 .  Thus 

yn  =  $T$>x„,  n  =  0,  1,  ...  ,  N  -  2.  (12) 

As  discussed  in  Section  4,  we  can  transform  the  output  data  set  y„,  n  =0,  1,  . . .  ,  N  -  2  by  a 
unitary  matrix  4>  and  not  change  the  equivalent  transient  weighting  vector  of  the  GS^  /c  -  i  structure. 
Thus  we  write 

u„'  =  =  r<t>x„,  n  =  0,  1 . N  -  2.  (13) 

Now  set  v„  -  <t>xM.  By  using  the  form  of  T  and  setting  u,J  =  (m„'(,  n„'2 . 

u;ik)r.\n  =  o'„|,  v„  i ,  ....  vnk)T ,  where  T  denotes  transpose,  it  follows  from  Eq.  (13)  that 

u,',  i  —  0,  (14a) 

“,',k  =  v„*.  k  =  2  3 . K. 

Define 

=  Vn.k  + 1  -  k  -  1.2 . K  -  1.  (14b) 


Fig  6  -  Further  decomposition  ot  GS*  \ 
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Hence,  the  number  of  input  r.v.'s  to  the  GS*-  ■  structure  has  been  reduced  by  1  (Fig.  6).  Note 
U„  =  Yn.  n  =  0.  1 . N  -  2. 

6.  NONSTATIONARY  NOISE  MODEL 

In  this  section  we  present  the  temporal  nonstationary  noise  model  of  the  inputs  to  the  GS  can¬ 
celler.  We  consider  separately  the  modeling  of  internal  and  external  noise  sources.  We  assume  that 
the  average  power  level  from  external  interference  sources  is  not  a  constant  from  sampling  time  to 
sampling  time.  Our  methodology  is  to  derive  lower  and  upper  bounds  on  the  output  noise  power  resi¬ 
due  of  the  adaptive  canceller  when  these  power  levels  are  known  exactly  at  each  sampling  time.  Thus 
these  bounds  are  conditioned  on  the  AC-specified  power  levels  of  the  external  noise.  Thereafter  a  joint 
probability  distribution  function  can  be  assigned  to  the  Af-specified  power  levels  and  upper/lower 
bounds  of  performance  can  be  derived  by  integrating  the  conditioned  upper/lower  bounds  over  the 
joint  probability  distribution  function.  More  specifically,  define 

/?„„  ,  (£)  =  (A’  -  1 )  x  (/V  —  1 )  auxiliary  covariance  matrix  of  the  external  interference 
time  step  k,  k  =  1,2 . K. 

r, =  N  -  1  length  cross-correlation  vector  between  the  auxiliaries  and  the 
main  channels  of  the  external  interference  at  time  step,  k, 
k  =  1,2 . K. 


We  se* 


=  °i  Qw.c 

(15) 

Ak ) 

fj 

II 

(16) 

where 


C is  a  constant  (A/  —  1)  x  (A/  —  I)  normalized  auxiliary  cross-correlation  matrix 
ot  the  external  noise  sources. 


r,,,,,.,'  is  a  constant  N  -  1  length  normalized  cross-correlation  vector  of  the 
external  noise  sources,  and 


nl  is  input  power  to  each  main  and  auxiliary  channel  at  time  instant  k, 
k  -  1.2 . K.  Assume  a}  =£  d  for  k  ,  *  k1. 

I  he  normalization  ot  ,  and  ,  results  from  setting  all  of  the  =  1  and  computing  the  result¬ 
ing  auxiliary  covariance  matrix  and  the  cross-correlation  vector  between  main  and  auxiliaries  of  the 
external  interference,  respecively. 


9 


K.  GERLACH 


Define 


wa  =  (w,,w2,  ...  ,H’iV_,)r  =  optimum  canceller  weighting  vector. 


/?,„  =  (N  -  1)  x  (N  - 1)  auxiliary  covariance  matrix. 


r(im  =  N  -  I  length  auxiliary-main  cross-correlation  vector. 


RiU1 1’  =  (N  -  1)  x  (/V  -  1)  external  interference  covariance  matrix. 


We  assume  all  internal  noises  are  temporally  and  spatially  statistically  independent  and  identically  dis¬ 
tributed.  zero  mean,  complex  stationary  Gaussian  noise  processes  with  power  a2,  which  without  loss 
of  generality  is  set  equal  to  1.  These  internal  noises  are  additive  in  each  channel.  We  note  that  all 
other  powers  are  referenced  from  <r  =  1 . 


For  the  noise  model  described. 


"  r«m 


R tm  Raa .  r  ^  (v  ! 


1  X 

i  2 

*  i  ■  I 


I  ^ 

-b  L  °i 

K  k  I 


c 


(17) 

(18) 

(19) 


(20) 


where  / v  .  i  is  the  (Af  —  1 )  x  (Af  —  1 )  identity  matrix  that  represents  the  internal  noise  covariance 
matrix.  Since  C,UI ,,  is  a  hermitian  matrix,  we  can  decompose  it  as 

Caa.r  =  *,  ?  *c  GD 

where 


T  is  the  real  diagonal  matrix  of  eigenvalues  of  Caa 
<t»,.  is  the  unitary  eigenmatrix  of  Cau  e,  i.e.  ,  $e  $[,  =  lN  - 1- 
Define 


(y  i  ,72 . 7  v  1 )  =  eigenvalues  of  C, 


a;  =  steady  state  (K  —  00)  main  channel  internal  noise  power  residue 
(after  cancellation). 
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a2e  =  steady  state  main  channel  external  interference  power  residue, 

afn  =  average  noise  power  (internal  and  external)  of  the  main  channel 
input,  and 

°min  =  total  steady  state  noise  power  residue. 


It  can  be  shown  that 


and 


a -  +  a; 


=  - 


-i 


p 

am  lxaa 


(22) 


o, 


?  =  1  +  r'  R  2  r 

i  i  i  a  /mi  *  *  /j/7  »  /» 


Thus 


(23) 


®fn  f  am  ^ aa  ^am  @7  •  (24) 

As  mentioned  in  Section  4,  the  auxiliary  inputs  (x\,x2 . jc,v-i)r  of  a  sidelobe  canceller  can 

be  multiplied  by  an  arbitrary  nonsingular  (N  -  1)  X  (iV  -  1)  matrix  transform  such  that  the  tran¬ 
sient  residue  is  unchanged.  Consider  the  implicit  matrix  transform  illustrated  in  Fig.  7.  In  this  fig¬ 
ure,  statistically  orthogonal izes  the  auxiliaries  with  respect  to  one  other.  We  note  that  the  inter¬ 
nal  noise  components  of  y,|,  n  =  1,2,  ..  .  ,  N  -l  have  unit  power  since  4>*  is  a  unitary  transform. 
The  outputs  of  the  <!><*,  <.  transform  are  denoted  by  vf,  y{,  ■  ■  ■  ,  V/v-i  •  We  optimally  weight  each  of 

these  by  the  vv,' ,  h’2' . which  minimizes  the  output  residue  of  yd .  This  weighting  does  not 

affect  the  transient  residue,  as  discussed  in  Section  4.  Next  Vq,  y(,  ...  ,  and  are  normalized 
so  that  the  average  power  (over  all  K  samples)  is  equal  to  1 .  This  normalization  does  not  change  the 
normalized  output  noise  power  residue.  The  outputs  ^0,  c(,  ...  ,  Zn-\  are  the  result¬ 
ant  outputs  of  this  normalization  procedure.  When  conditioned  on  their  respective  power  levels,  these 
inputs  entering  the  GSK  N  canceller  are  spatially  and  temporally  statistically  independent  of  one 
another.  More  explicitly  if  z„  =  [^,,(1),  c„(2),  .  . .  ,  £„(/())  T  is  the  input  vector  of  K  samples  then 

E  { , (A:  i )  z*,(A'2)i  =  0.  unless  77 1  =  n2  and&|  =  k2,  (25) 

and 


^  £  £IU„(*)I2I  =  i. 

A  *  =  i 


(26) 


It  is  straightforward  to  show  that 

E\  Uo(*)|2!  =  «0(7o  °l  +  oj),  k  =  1,2 . K  (27) 

and 

E\  |  z„(k)  | 2 1  =  atn(y„  al  +  I),  k  =  1,  2 . K ,  n  =  1,  2 . N  -  1  (28) 
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MAIN  AUXILIARIES 


Fig.  7  -  Equivalent  canceller  using  correlated  inputs 
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where 


K 


E 


k  - 1 


■>"  _  — 
a~ 


7  7 


«o  =  ho  +  CT/‘l 


2i-l 


a„  =  [7,1  ff2  +  I)  n  =  1,2 . N  -  1. 


We  define 


X'0'  - 


«o(7o  o\  +  o-) 

<20(70  °\  +  oj) 


ao(7«  °k  +  <*r) 


and 


oi„  (y„  o T  +  1) 

««  (7/,  03  +  1) 


«n  <7/1  OX'  +  1) 


(29) 

(30) 

(31) 

(32) 


(33) 


(34) 


Thus  each  sample  in  a  given  channel  can  be  characterized  by  specified  variances.  The  /(-length  data 

vector  in  mh  channel  is  completely  characterized  by  X(,l\  n  =  0. 1 . N  -  1.  and  the  fact  that  (1) 

its  elements  when  conditioned  on  their  respective  power  levels  are  spatially  and  temporally  statisti¬ 
cally  independent  all  other  data  samples,  and  (2)  are  complex  Gaussian  processes.  We  note  that 
without  loss  of  generality  we  can  order  the  o%'  k  =  1,2 . K  as 

17  7  7 

a]  <  as  <  a}  •  •  •  <  a k. 


7.  2-INPUT  GS  CANCELLER 

The  basis  for  understanding  the  convergence  properties  of  a  GS  canceller  begins  with  studying 
the  2-input  GS  canceller.  We  assume  the  input  data  noise  model  as  defined  in  Section  6  and  that 
these  data  satisfy  assumptions  (1)  through  (5)  given  in  Section  2.  We  set  A„.n  =  0.1.2 . N  -  1 


13 


K.  GERLACH 


equal  to  a  K  x  K  diagonal  matrix,  where  the  kth  diagonal  elements  of  A„  are  given  by  the  fcth  element 
of  X'n).  We  write  the  output  residue  as  Znw.  Thus 


where 


Znw  =  X0  ~  wX  i 


*1*0 

w  —  - . 

*1*1 


(35) 


(36) 


Furthermore,  we  can  show  that  the  normalized  X-averaged  transient  output  noise  power  residue 
is  given  by 


E[  |  Znw  | 2  |xo'*i) 


(37) 


=  1  +  |  w  |  2, 


l*|Xol2 
(xWt)2  ■ 

Because  the  elements  of  x«  are  Gaussian  and  independent  of  the  elements  of  X| , 


*i  I 


*iAo*i 
(x',X,)2  ' 


(38) 


Now  we  can  write 


*i 


=  A 


1/2, 


(39) 


where  v,  is  a  vector  of  identically  distributed,  zero  mean,  unit  variance,  independent  complex  Gaus¬ 
sian  r  v.’s  with  independent  real  and  imaginary  parts.  Thus 


£(ffmv|v,|  =  1  + 


v'i  ApA]  V| 

(v'i  A,  v,)2 


(40) 


It  is  shown  in  Appendix  A  that 


a2nJK,  2)  =  1  +  £  £  \*0)  a(n,k)  F  (X^.X^) 

*  =  1  n=  1 
n 


(41) 
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where 


r  l 


A 


ti) 

n 


,  1  <  n,  k  <  2  ;  for  K  =  2 


a(n.  k) 


— - - - - ;  1  <  n,k  <  ;  for  K  >  2 

n  (x<'>  -  o 

m  =1 
m  ±n,k 


V. 


h\\}\  xi1’)  = 


A!,1 


.(I) 


-XI1 


xi1 


.(i) 


-X[‘ 


In 


(42) 


(43) 


8.  PRELIMINARY  DEFINITIONS  AND  THEOREMS 

Before  deriving  bounds  for  the  convergence  of  an  /V-input  canceller,  we  give  preliminary 
theorems  necessary  for  obtaining  these  bounds.  Observe  \\n)  <  A(M)  <  .  .  .  <  A*1  and  let 
e  =  (e  | ,  e2 . Or)7-  Define  the  following  K  —  l  +  1  length  vectors 

e/  (/)  =  (C|,  e2 . Ck_/  +  i)  (44) 

ea  (/)  =  (et,  e!  +  t . eK)  (45) 


The  L  or  U  subscript  on  a  vector  indicates  whether  the  lower  or  upper  K  -  l  +  1  elements  of  that 
vector  are  used.  Let  the  random  vector  Vj  be  as  defined  in  Section  7.  Define  the 
(K  -  /  +  1)  x  (K  ~  /  +  1)  diagonal  matrices  Av  n  and  A/  „  whose  diagonal  elements  are  given  in 
order  by  the  elements  of  and  X^0(/),  respectively.  The  following  quantities  are  defined  and  are 
used  in  evaluating  upper  and  lower  bounds  of  N): 


and 


{/(/,  K,  \a,.\l0))  =  E 


v'i  At/.  pAt/./Vi 

(v'iA^/V,)2 


(46) 


L(l ,  K,  X,,,,X,0))  =  E 


V|AL,0ALJVi 

(v'iA^/V,)2 


(47) 
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The  following  theorems  give  formulations  for  U(l,  K,  X(/),X(0))  and  L(l,  K ,  X(/),X<0)). 


Theorem  1:  Define  for  /  =  1,  2 . N  -  1 


a, In.  k.  /.  X(/)) 


,  1  <  n,  k  <  2,  if  K  -  l  +  1  =2 


[x;; 


U)iK  -I  —2 


K  —I  +  \ 

n  (x!,0  -  x'?) 

m  =  1 
w 

undefined  if  n  =  k 


,1<«,  A  <  XT  -  /  +  1,  K  -  I  +  \  >  2 


(48) 


av[n,  A',  /,  X(,)) 


X<'> 


,  K  -  \  ■<  n.  k  <  K\  if  K  -  l  +  \  =  2 


[X^’l 


K-l-2 


n  (C  -  Xji») 

m  =/ 
m 

undefined  if  n  =  k 


,  l  <  n,  k  <  K,  K  -  l  +  1  >  2 


(49) 


Gv(k,  /,  X(/))  =  K  £'  aL(n,  k,  I,  X(/))  F(X<'\  Xf),  /  =  1,  2,...  ,Af-l;l  <  A  s  AT  -  /  + 1,  (50) 

n  =1 
n  ±k 


K 

GL{k ,  /,  X(/))  =  2  x<,))  F  (X(„0,  xf),  /  =  1,  2 . (V  -  1;  /  <  k  <  K,  (51) 

n  =1 
n  *k 


where  F(-.  ■)  is  defined  by  Eq.  (43).  Then 


K -l  +  |  \  (0) ,  \(0 

f/(/,  X(/>,  X(0))  =  £  0  Gi/(*,  /,  X(/)),/  =  1,2 . Af  -  1,  (52) 

*=i  Xjt' 


L(l,  K,  \a\  X,0>)  -  £  -——777^  /  +  ‘  GL(k,  /,  X(/)),/  =  1,2 . N  -  1.  (53) 


k  =/ 


XI0 
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Proof:  The  proof  is  given  in  Appendix  B. 

We  use  the  following  variant  of  the  Poincare'  separation  theorem  [11], 

Theorem  2:  Let  A  be  a  K  x  K  hermitian  matrix  with  eigenvalues  X|  <  X2  . . .  —  Let  B  be  a 

(K  -  1)  x  K  matrix  with  K  —  1  orthonormal  columns.  Let  X(  <  X/  . . .  <  X£_i  be  the  eigen¬ 

values  of  B*AB' .  The  following  inequalities  hold: 

X!  <  X,'  <  X2  <  X2  <  .  .  .  <  \K~\  —  hj(  - 1  <  \K.  (54) 

Note  that  if  the  equality  is  removed  so  that  X|  <  X2  .  .  .  <  X*,  then 

Xi  <  X|  <  X2  <  X2  <  .  .  .  <  XA  _i  <  X£_|  <  X*.  (55) 

Thus  the  X„.  n  -  1,  2 . K  —  1  are  distinct  if  the  X„,  n  =  1,2,...  ,  K  are  distinct. 

Define 


X('"'  =  (XV"',  XV"',  ...,  XV"-, ').  (56) 

Theorem  3:  If  X','"  <  X','"'  <  XV"  <  XV" '  <  .  .  .  <  XV"L|  <  Xj?L,  '  <  X£\  for  n  =  0,  1 . 

N  -  1.  then 

HI  +  1,  K,  X(/),  X,0))  <  L(l,  K  -  1,  X(/)',  X(0)') 

<  U(l,  K  -  1,  X'"',  X(0)')  <  U(l  +  1,  K ,  X'",  X[)").  (57) 

Proof:  The  proof  of  this  is  straightforward  and  follows  by  direct  comparison  of  the  terms  (which  are 
all  positive)  in  these  expressions. 

9.  BOUNDS  FOR  NONCONCURRENT  GS  CANCELLER 

In  this  section,  we  prove  the  following  theorem  pertaining  to  nonconcurrent  GS  cancellation  in 
nonstationary  noise. 

Theorem  4:  If  X(">  <  XV"  <  .  .  .  <  X^*  for  n  =0,  1,  .  .  .  ,  N  —  1  and  assumptions  (1)  through  (5) 
hold,  then 

nil  +  Ul ,  K ,  x(0,)l  <  o2nw{K,  N)  <  n  [1  +  V  (l-  K,  \(N~n,  X,0))].  (58) 

/= i  / = i 


Proof:  We  prove  this  by  mathematical  induction.  We  have  shown  that  the  theorem  is  true  for  N  =  2 
(see  Section  7  and  the  definitions  of  L,  U ,  given  in  Section  8).  Thus,  we  can  assume  that  the 
theorem  is  true  for  all  integers  less  than  or  equal  to  some  upper  bound,  N  —  I.  We  show  that  the 
theorem  is  true  for  N ,  which  implies  that  it  is  true  for  any  N  >  2.  Recall  that  the  nonconcurrent 
inputs  are  equi-power.  In  addition  the  samples  of  Xo  when  conditioned  on  their  respective  power  lev¬ 
els  are  spatially  and  temporally  statistically  independent  of  the  samples  in  the  auxiliary  channels. 
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We  decompose  the  GS^ processor  as  shown  in  Fig.  5  and  further  reduced  in  Fig.  6.  Our 
methodology  is  to  derive  bounds  on  the  output  noise  power  conditioned  on  \N  _  | ,  which  we  write  as 
/•.'I  I  Z,m  1 2  !  \.v_,  |.  Thereafter,  we  see  that  alw(K,  N)  -  |  Z„„.  | 2 1  is  readily  derivable.  The  K- 
length  output  vectors  y„,  N  =  0,  .  .  .  .  N  -  2  of  the  channels  from  the  First  level  are  given  by  Eq. 
(12).  As  discussed  in  Section  5,  the  number  of  concurrent  inputs  per  channel  into  the  succeeding 
GSk  \  |  processor  is  essentially  reduced  by  one.  These  concurrent  inputs  are  now  given  by  the 
< K  -  It-length  vector  denoted  by  u„,  n  =  0,  1 . N  -  2  and  defined  by  (14b).  It  is  straightfor¬ 
ward  to  show  that  the  main  channel  samples  of  u<,  conditioned  on  and  their  respective  power 

levels  are  spatially  and  temporally  independent  of  u„.  n  =  1 . N- 2.  and  that  the  nonconcurrent 

samples,  U„ ,  n  =  0,  1 . N  -  2  are  equi-powered.  Hence,  assumptions  (1)  through  (5)  hold  for 

the  reduced  input  set  (note  for  assumption  (5),  K  -  1  >  N  -  1).  Hence,  the  bounds  given  by 
Theorem  5  can  be  applied  for  the  equivalent  GS^  _  1;V  - 1  canceller  (see  Fig.  6)  if  the  temporal  corre¬ 
lation  matrix  for  each  channel  were  known. 

We  define  a~lin  to  be  the  minimum  output  residue  of  the  GS^_  |  ,v  -  i  canceller  if  we  use  a  fin¬ 
ite  K  in  the  first  level  of  canceller  seen  in  Fig.  5  and  use  an  infinite  number  of  samples  (steady  state) 
in  the  GSK  LV  i  canceller.  Let  B  be  a  (K  -  1)  x  K  matrix  formed  by  using  the  second  thru  £th 
rows  of  <f>.  which  is  defined  by  Eq.  (11).  Thus 

u„  =  Sx„.  n  =  0,  1,  2 . N  -  2  (59) 

A'n  =  £(u*u,[)  =  B*AnBr  ,  (60) 

where  A,\  in  the  correlation  matrix  of  u„,  n  =  0,  1,  . . .  ,  N  -  2.  Define  X1"’',  X|>n)',  . .  .  X^'L|  '  to 
be  the  eigenvalues  of  A,].  In  lieu  of  the  Poincare'  Separation  Theorem  (see  Theorem  2)  and  the  origi¬ 
nal  assumption  on  ordering,  (55)  holds 

Thus  invoking  Theorem  4,  which  we  have  assumed  is  true  n  <  N  —  1,  since  \\n) '  < 
XV'1 '  <  ...  <  X/'- '. ,  then  the  conditional  expectation  of  the  noise  power  can  be  bounded  as 


n  I  •  +  ^(L  k-  i,  X'*-1-'1',  x"'”) 

/-I  1 


^min 


N -2 

<  n 


/ = i 


1  +  (/(/.  K-  1,  x(0)') 


(61) 


We  outline  the  remainder  of  the  proof.  The  bounds  given  by  (61)  can  be  bounded  by  those 
given  by  Theorem  3.  The  <7n„n  is  multiplied  through  all  the  new  bounds.  Next,  the  joint  probability 
distribution  function  (p.d.f.)  of  the  elements  of  x^_i  is  multiplied  through  all  the  bounds  and 
integrated  out.  Finally  EjOm,nl  is  bounded  by  using  the  results  of  Section  7.  As  a  result.  Theorem  4 
follows.  End  of  proof. 

We  have  derived  upper  and  lower  bounds  of  the  expected  value  of  the  output  noise  power  resi¬ 
due  of  the  GS  canceller  that  depend  on  the  values  of  the  elements  of  X<''),  n  =  0, 1 . N  —  1 .  As 

shown  in  Section  6  these  elements  depend  on  a„  y„,  n  =  0, 1 . N  —  1,  a,,  and 
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-j  ^  7  7 

a%,  k  =  1,2 . K.  Furthermore,  an,yn,  and  a;  depend  on  CMf,  cam  e,  ajn,  and  o k, 

k  =  1,2, ...  ,K.  We  can  generalize  these  bounds  by  considering  a\ ,  k  =  1,2, .. .  ,K  to  be  random 
variables  with  a  joint  distribution  function  P2j  (a2,  a2,...  ,  o\).  We  can  consider  a2w(K,N)  to  be 
the  expectation  for  the  normalized  canceller  output  residue  conditioned  on  a2,  k  =  1,2, ..  .  ,K,  and 
define  a2w  (K,N)  to  be  the  expectation  of  the  normalized  canceller  output  residue.  Mathematically 
this  is  expressed  by 


o2nw(K,N)  =  |  o2nw(K,N)  dPs(o],o22, . .  .  ,a2k).  (62) 

We  note  that  defining  a  joint  distribution  function  for  a2 ,  a2 , . . .  ,  a\  changes  the  original  assump¬ 
tions  on  the  input  processes.  The  input  process  is  no  longer  Gaussian  and  independent  from  sample 
to  sample.  However  the  input  process  conditioned  on  a2 ,  a\,  ■ . .  ,  a\  is  Gaussian,  and  the  uncondi¬ 
tioned  input  process  is  uncorrelated  from  sample  to  sample.  Defining  a  joint  distribution  for 
ay,  as.  .  .  .  ,  allows  a  variety  of  nonstationary  interference  scenarios  to  be  modeled  and  evaluated 
(for  example,  finite-state  jump  Markoff  processes,  continuous  or  discrete  time  processes,  mixed  distri¬ 
butions).  Bounds  on  a;w(K,N)  are  found  by  integrating  the  lower  and  upper  bounds  given  by  (58) 
over  dPa'(a\-  a2 . a2K). 

Finally,  we  note  that  one  of  our  assumptions  is  that  \\n) ,  X^n),  . . .  ,  Xj£ \  n  =  0, 1 . N  -  \ 

are  distinct,  i.e.,  X}"'  &  Xjn)  for  i  ^  j.  We  can  approximate  with  arbitrary  accuracy  the  case  when 
these  values  are  not  distinct  by  merely  adding  or  subtracting  a  small  perturbation  about  each  non- 
distinct  Xf’  to  make  it  distinct.  These  bounds  can  then  be  evaluated  to  within  an  arbitrary  accuracy 
of  the  true  value  of  the  bound. 

10.  SUMMARY 

Convergence  results  for  the  Sample  Matrix  Inversion  (SMI)/Gram-Schmidt  (GS)  canceller  algo¬ 
rithm  in  temporally  nonstationary  noise  was  investigated  by  using  the  GS  canceller  as  an  analysis  tool. 
Lower  and  upper  bounds  for  the  convergence  rate  of  the  canceller’s  average  output  noise  power 
residue  normalized  to  the  quiescent  average  output  noise  power  residue  were  derived.  These  bounds 
are  a  function  of  the  number  of  independent  samples  processed  per  channel  (main  or  auxiliary),  the 
number  of  auxiliary  input  channels,  and  the  external  noise  environment.  The  external  noise  environ¬ 
ment  was  modelled  as  Gaussian,  with  a  power  level  specified  at  each  sampling  time  instant.  Further¬ 
more,  this  model  was  generalized  in  the  sense  that  a  joint  probability  distribution  function  is  defined 
for  the  power  levels  over  a  canceller  processing  batch.  This  leads  to  the  capability  of  modeling  and 
evaluating  the  SMI/GS  canceller  in  a  variety  of  interference  scenarios  such  as  continuous  or  discrete 
time  processes  or  a  mix  of  these. 
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Appendix  A 

DERIVATION  OF  2-INPUT  GS  CANCELLER  NOISE  POWER 

In  this  appendix  we  find  an  exact  expression  for  a;,w(K,  2).  Starting  from  Eq.  (38),  we  can 


K  I  Xi 

^  will  I  -  k 


E  a;M.  |x  =  1  +  £  Xf*-^- 
k=  1  (xx)‘ 


where  without  loss  of  generality,  we  have  set  x  =  X|  and  x  =  (jcj  ,  xi,  . . .  ,  **)  •  Set 


(x'x)2 


+  £  Uni" 


*  =  1,2 . K. 


We  find  £fa*|,  k  =  1,2,...  ,  K.  Define 


=  \xk 


z2  =  E  U«l2- 


«*  =  — T  T-  (A5> 

(z  i  +  z2) 

It  is  shown  in  Appendix  C  that  if  Xi1*,  k  =  1.2,...  .  K  are  distinct,  then  z,  and  z2  have  the 
following  p.d.f.’s: 


,  ,  1  K"  n 

pzMO  =  ^  ,  z,  >  0 


PzAz 2)  =  E  k^e  "  .  z2  5:  0 
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where 


a  in,  k) 


.  for  K  =  2 


,  (IKK  3 


;  k  for  K  >  2 


n  «"  -  c> 

m  -1 
m  &n.k 


£|ati  =  (  (  - — - r  p-(Z\)p-.(Z')(Jz\(Jz-<. 

(>  0  (c,  +  z2r 


Substituting  (Ah)  and  (A7)  into  (A9)  results  in 


£(<**1  —  Z*  k)F ()(X„,  X,)  , 

n  -  \ 
n  ±k 


(A  10) 


where  we  define 


f»  (x:,h.  xi")  =  -f-i*  c  — - 
xV'xi"  J"  J(»  <-■  + 


(-1  +7;)' 


x;"  x;"  ,  . 

e  dz  i  dz2  ■ 


(All) 


Let  ii  i  =  z.  i  /Xi  ",  K;  =  C;/X[,  With  this  change  of  variables  the  double  integral  in  (All)  becomes 


FltlK"  Xi")  =  Xi"  f  °°  \  °°  - : - L— - ; 

‘  J'»  (Xi1^,  +  x:,1^,)2 


e  “  "  du  I  du  ■>  . 


(A12) 


Define 


G(X!,".  Xi")  =  J  (  — - -  ——  c  ~u'  “  du  \du •>. 

xi"H|  +  x;,"m2 


(A  13) 


Note  that 


F»(XL".  Xi")  -  -Xi' 


!)G(Ku.  Xi") 


(A14) 
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We  now  find  an  expression  for  G(X|".  Xi").  By  setting  j!  =  Xi"wi,  Zz  =  Kl>u: 


G(X!,h.  Xi") 


1  f  00  r  00  1  Xi"  K"  ,  j 

— —  1 - e  dz\  dz->. 

Xin  3  o  J  »  ci  +  z-> 


k"  m" 


(A15) 


G(X;,l\  Xi")  =  E 


’  i  +  *■: 


(A1C) 


where  ~  ,  and  are  independent  random  variables  with 


,  ,  1  x;" 

P:t  (C|)  =  —  e 

Kk 


(A17) 


,  .  1  x„" 

PzdZ2)  =  —  e 


(A18) 


An  expression  for  E  |(c ,  +  :i)  1 }  is  derived  in  Appendix  C,  and  its  form  is  given  by  (C12).  Thus 


i  Xn) 

c,x“ # 


(A19) 


By  using  (A  14),  it  follows  that 


FM"'  Xi") 


x;,"  -  xi"  xi" 


(A20) 


Define  F(X"\  Xi")  =  Xi"  F„  (X"\  Xi")  or  equivalently 


}  (X1"  Xi")  =  X*  1  1  _  _ _  |n  hlL 

"  '  1  x;,"  -  XI"  X!,"  -  XI"  Xi" 


(A21) 


Substituting  F(Xi",  Xi")/Xi"  for  F()  (Xj".  Xi")  in  (A10)  and  then  substituting  (A10)  into  (Al)  results 


°L  (K,  2)  =  1  +  £  £  Xi0'  ain,  k)  FfXj,",  Xi")  . 


(A22) 


Appendix  B 

PROOF  of  theorf:m  1 


We  outline  a  derivation  of  UU,  K.  X,/l , X(<" ).  The  derivation  of  L(L  K,  follows  the 

same  methodology,  so  it  will  not  be  presented.  Starting  with  (46),  we  write 


v'V.,.V„V  «  <•! . .  !>■.[■ 

— - —  ~  L  X/»*  i 

1  v'A,  /V  i  "  A  -i  (v'A/../V)- 


*  x/v* - ,  xjv,  xn»-*i 


</»  if.  i  * 


V 

k  I 


(v'A/.v)2 


(Bl) 


where  without  loss  of  generality  we  have  set  v  =  v,  and  v  =  ( v , .  Vi . _/  +  1)7.  Set 

.v*  =  (A^  )'  -*•*  k  =  1.2 . K  -  I  +  I  (B2) 

x  =  (  v  I .  x2 . u  /  .  1 )' ■  (B3) 

Substituting  (B2)  into  (Bl )  and  taking  the  expected  value  of  both  sides 


Set 


I  i 

* 1  \>V,  x/i*., 

.£J 

rimn 

}  (v'A/  V)-  J 

■^3 

i 

[  (x'x)2  J 

(B4) 


«a  = 


(B5) 


General  expressions  for  were  derived  in  Appendix  A.  The  upper  bound  given  in  Theorem  1 

follows  by  using  these  general  expressions  with  the  proper  index  with  respect  to  I. 
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Appendix  C 

DERIVATION  OF  EQS.  (A6),  (A7),  AND  (A19) 

We  derive  an  expression  for  £|l/x'x|  where  x  =  (.v  1 .  . xK)r  and  each  xk  is  an  indepen¬ 

dent.  zero-mean,  complex  Gaussian  random  variable  with  variance  equal  to  \k.  We  assume  that 
\k  \k  for  k  |  &  k  2  and  K  >  2 .  Set 

-  =  I x i  I "  +  I x i | "  +  •  •  •  +  | xK | -  (Cl) 


«*  =  I  -V*  |  2  ,  £  =  1.2 . K. 


Now  uk  is  real  and  has  a  p.d.f.  given  by 


.  ,  1  x. 

PUi(“k)  =  —  e 

kk 


uk  >  0 


and  characteristic  function: 


=  -  2 - -  (C4) 

Ai  1 

Jo>  -  — 

kk 

Hence  since  the  uk  are  independent,  the  characteristic  function  of  z  is  given  by  the  product  of  the 
characteristic  functions  of  uk .,  k  =  1 ,  2 . K  or 

£-M  =  (-1)K  n  T - — -■  (C5) 

k  =  |  kk  ;  1 

K  1  7W  -  — 

At 

By  using  a  partial  fraction  expansion  of  P.(u)  and  the  inverse  characteristic  function  transform, 
it  can  be  shown  that 


P:(z)  =  £  ake  ‘  >  0, 

k  =  1 

where 


n  (x*  -  x„) 
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We  now  show  that 


E 


£  ak  In 

=  i 


(C8) 


Set  o)k  =  1  /\k ,  k  =  1,  2,  .  . .  ,  K.  Define  a  function  of  F  such  that 

£ak*—dz,  (C9) 

*  =!  2 


F(tO| ,  o)i,  ■  ■  ■  ,  o)k)  —  | 


K 

where  ak.  k  =  1 ,2,  .  .  . , K  are  arbitrary  constants  satisfying  the  constraint  ak  =  0.  We  note  that 

k  =1 
K 

for  the  ak  defined  by  (Cl),  F(o)X,o)i,  ■  ■  ■  ,«*>  =  £jl/x'xj  and  £  ak  =  0.  We  can  show  that  F 

k  =  l 

exists  if  all  o)k  >  0.  Note  that  the  summation  and  integration  cannot  be  interchanged  in  (C9)  because 
the  resultant  would  be  unbounded.  It  is  straightforward  to  show  that  dF/d o)k,  k  =1,  . . .  ,  K  exists 
and  is  equal  to  -ak/o)k.  Furthermore,  we  can  show  that  the  only  form  of  F  that  satisfies  these  K  par¬ 
tial  derivative  equations  is 

K 

F(o)\,  o)i,  ....  o)k)  =  —  ^2  ak  In  o)k  +  C  (CIO) 

*  =  1 


where  C  is  a  constant  to  be  determined.  Since 

X>=0,  (Cll) 

k  =1 


for  all  o)k  equal  to  o)  using  (C9),  it  follows  that  F(o),  o) . w)  =  0.  By  using  this  fact  and  (Cll) 

in  (CIO),  C  =  0  and  (C8)  follows. 


Substituting  the  expressions  given  by  (Cl)  into  (C8)  results  in 

"  "  'K~2  In  Xi 


1 

x'x 


K  Xf 

D  ~K - 

*=l  n  -  K) 


n  =1 
n 


We  note  that  for  K  —  2, 


(Cl  2) 
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